Combining Classical and Embodied Multimodal Fusion for Human-Robot Interaction
نویسندگان
چکیده
Classical artificial intelligence (CAI) and embodied cognition (EC) were successfully applied in different areas: CAI has its strength in fields such as planning or high-level cognition, which require a precise computation that involves logical inference; EC produced excellent approaches for sensori-motor coupling, which requires a robust and flexible computation. The question that we are following here is if the preciseness of CAI can be integrated with the robustness of EC? Speech Recognition
منابع مشابه
Comparing classical and embodied multimodal fusion for human-robot interaction
A robot that interacts with a human has to be able to interpret information from various input channels: it needs to understand and analyse the utterances by the human, it has to keep track of its own environment using sensors, and it needs to incorporate background knowledge about the task it was built for. Typically, a human-robot interaction system has various specialised system components t...
متن کاملUsing Embodied Multimodal Fusion to Perform Supportive and Instructive Robot Roles in Human-Robot Interaction
We present a robot that is working with humans on a common construction task. In this kind of interaction, it is important that the robot can perform different roles in order to realise an efficient collaboration. For this, we introduce embodied multimodal fusion, a new approach for processing data from the robot’s input modalities. Using this method, we implemented two different robot roles: t...
متن کاملAchieving Multimodal Cohesion during Intercultural Conversations
How do English as a lingua franca (ELF) speakers achieve multimodal cohesion on the basis of their specific interests and cultural backgrounds? From a dialogic and collaborative view of communication, this study focuses on how verbal and nonverbal modes cohere together during intercultural conversations. The data include approximately 160-minute transcribed video recordings of ELF interactions ...
متن کاملMultimodal fusion system for NDT and Metrology
3D scanning and modeling is used in a wide range of applications like manufacturing, aerospace, security, biomedicine, etc. This kind of systems allows the scanning of a 3D point cloud that can be meshed and rendered in order to obtain a complete 3D model. However, 3D vision cannot detect subsurface defects. This later can be achieved using other imaging modalities, like thermal infrared imagin...
متن کاملMultimodal Feedback from Robots and Agents in a Storytelling Experiment
In this project, which lies at the intersection between Human-Robot Interaction (HRI) and Human-Computer Interaction (HCI), we have examined the design of an open-source, real-time software platform for controlling the feedback provided by an AIBO robot and/or by the GRETA Embodied Conversational Agent, when listening to a story told by a human narrator. Based on ground truth data obtained from...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2012